|
In the theory of probability, the Glivenko–Cantelli theorem, named after Valery Ivanovich Glivenko and Francesco Paolo Cantelli, determines the asymptotic behaviour of the empirical distribution function as the number of independent and identically distributed observations grows. The uniform convergence of more general empirical measures becomes an important property of the Glivenko–Cantelli classes of functions or sets. The Glivenko–Cantelli classes arise in Vapnik–Chervonenkis theory, with applications to machine learning. Applications can be found in econometrics making use of M-estimators. Assume that are independent and identically-distributed random variables in with common cumulative distribution function . The ''empirical distribution function'' for is defined by : where is the indicator function of the set . For every (fixed) , is a sequence of random variables which converge to almost surely by the strong law of large numbers, that is, converges to pointwise. Glivenko and Cantelli strengthened this result by proving uniform convergence of to . Theorem : almost surely. This theorem originates with Valery Glivenko,〔Glivenko, V. (1933). Sulla determinazione empirica della legge di probabilita. Giorn. Ist. Ital. Attuari 4, 92-99.〕 and Francesco Cantelli,〔Cantelli, F. P. (1933). Sulla determinazione empirica delle leggi di probabilita. Giorn. Ist. Ital. Attuari 4, 221-424.〕 in 1933. Remarks *If is a stationary ergodic process, then converges almost surely to . The Glivenko–Cantelli theorem gives a stronger mode of convergence than this in the iid case. *An even stronger uniform convergence result for the empirical distribution function is available in the form of an extended type of law of the iterated logarithm. See asymptotic properties of the Empirical distribution function for this and related results. ==Empirical measures== One can generalize the ''empirical distribution function'' by replacing the set by an arbitrary set ''C'' from a class of sets to obtain an empirical measure indexed by sets : Where is the indicator function of each set . Further generalization is the map induced by on measurable real-valued functions ''f'', which is given by : Then it becomes an important property of these classes that the strong law of large numbers holds uniformly on or . 抄文引用元・出典: フリー百科事典『 ウィキペディア(Wikipedia)』 ■ウィキペディアで「Glivenko–Cantelli theorem」の詳細全文を読む スポンサード リンク
|